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The  Hypcrspectral  Imager  for  the  Coastal  Ocean  (HICO)  has  been  operating  on  board  the  International 
Space  Station  sinee  installation  on  24  September  2009.  HICO  provides  100  m  resolution  hyperspeetral 
imagery  optimized  for  the  coastal  ocean.  However,  accurate  retrieval  of  bio-optical  properties  from 
these  oeean  eolor  measurements  relies  on  aeeurate  atmospherie  corrections;  a  small  inaccuracy  in 
atmospheric  corrections  can  lead  to  significant  errors  in  the  retrieved  products. 

In  this  study  we  examine  results  from  two  atmospheric  correction  approaches  applied  to  HICO  data. 
The  first  atmospheric  correction  approach  is  the  standard  multispcctral  Gordon/Wang  NIR  atmospherie 
correction  applied  to  HICO  MODIS-like  channels  using  appropriate  MODIS  relative  speetral  response 
tables.  The  second  approach  is  the  Cloud  and  Shadow  (C&S)  atmospheric  correction  which  is  a  scene- 
dependent  method  that  requires  aeeurate  detection  of  a  cloud-shadow  pair  and  a  neighboring  sunny 
region  which  has  the  same  water  properties  as  the  shadow  region.  Although  clouds  are  relatively  easy 
to  deteet,  detecting  their  shadows  over  deep  water  is  quite  challenging.  In  this  study  we  also  introduce 
an  automated  cloud  shadow  detection  approach;  for  convenience  we  call  it  the  Cloud  Shadow 
Algorithm  (CSA)  and  it  seems  to  work  reasonably  well  over  homogeneous  water  bodies.  We  present 
some  preliminary  results  comparing  the  two  atmospheric  correction  approaches  and  also  some 
preliminary  results  of  the  shadow  detection  approach. 

INTRODUCTION 

The  fundamental  measurement  in  ocean  color  remote  sensing  is  the  water-leaving  radiance,  the 
upwelling  spectral  distribution  of  the  radiance  from  the  ocean.  Geophysical  parameters  such  as 
chlorophyll  concentrations  ean  be  retrieved  from  this  water-leaving  signal  since  it  contains  information 
about  the  optically-activc  components  in  the  water  column.  However,  only  about  10%  of  the  total 
signal  measured  by  the  oeean  eolor  sensors  contains  information  about  the  waters;  the  rest  represents 
scattering  from  aerosols  and  air  molecules.  The  goal  of  the  atmospheric  correction  over  the  oeean  is  to 
remove  contributions  from  the  atmosphere  and  reflection  from  the  sea  surface. 

Gordon  and  Wang  (1994)  [1]  developed  an  atmospheric  correction  scheme  for  the  open  ocean  where 
the  aerosol  contribution  is  estimated  using  Top  of  the  Atmosphere  (TOA)  radiancc/rcflectance  signals 
obtained  from  near  infrared  (NIR)  bands.  This  approach  assumes  that  the  ocean  is  optically  blaek  in 
the  NIR  bands  due  to  the  strong  water  absorption.  Although  this  technique  works  well  in  the  open 
ocean,  it  breaks  down  in  optically  complex  eoastal  waters,  sinee  the  blaek  pixel  approximation  no 
longer  holds  true  due  to  strong  reflections  from  organie  and  inorganie  particulate  matters.  If  water- 
leaving  radiance  is  not  negligible  in  the  NIR  bands  then  the  retrieved  aerosol  loading  will  be 
overestimated,  resulting  in  underestimated  or  even  negative  water-leaving  radiances.  However,  for  our 
data  processing  we  use  the  NIR-iterative  procedure  for  the  eoastal  waters  [2]  and  standard  NIR 
procedure  for  open  ocean  on  multispectral  (convolved)  HICO  MODIS-like  bands.  The  NIR-iterative 
procedure  reduces  number  of  pixels  with  negative  readings  in  the  coastal  waters.  Another  atmospheric 


correction  approach  for  coastal  water  was  proposed  [3]  which  uses  short  wave  infrared  (SWIR)  bands. 
This  approach  is  based  on  the  fact  that  ocean  water  absorbs  strongly  in  this  spectral  region,  and  the 
contributions  of  the  in-water  constituents  arc  negligible  and  can  safely  be  considered  dark.  However, 
these  SWIR  bands  don’t  exist  on  Hyperspcctral  Imager  for  the  Coastal  Ocean  (HICO).  Furthermore, 
the  atmospheric  reflectance  itself  is  significantly  weaker  in  SWIR  region  and  spectral  features  arc 
particularly  difficult  to  resolve.  In  such  situations,  the  cloud  and  shadow  (C&S)  atmospheric 
corrections  [4,  5J  can  be  very  helpful.  However,  C&S  is  limited  to  images  with  cloud  and  shadow 
present. 


The  C&S  atmospheric  correction  method  [4,  5]  is  appropriate  for  high-spatial  resolution  sensors  such 
as  HICO.  This  approach  uses  cloud  and  shadow  pixels  along  with  close  by  sunny  pixels  with  similar 
optical  properties.  First,  it  estimates  the  atmospheric  and  sca-surfacc  reflectance  La  from  a  pair  of 
adjacent  pixels  that  are  in  and  out  of  a  cloud  shadow  while  ignoring  the  slight  (<5%)  differences  in  the 
remote-sensing  reflectance  Rrs(A)  under  the  two  regions  [6-9],  Estimation  of  La  also  requires  an 
estimate  of  the  ratio  between  the  downwelling  sky  irradiancc  to  total  downwclling  irradiancc 


EfW. 


£  (A)  which  can  be  estimated  using  Radtran  [10]  for  a  given  location  and  time.  In  order  to 

calculate  Rrs  (A) ,  the  product  of  atmospheric  transmittance  and  downwclling  irradiancc  t(A)£'(/(A)just 
above  the  surface  is  also  needed.  For  this  component  the  radiance  over  the  cloud  is  used  to  make  the 
estimate.  Once  the  Rn(A)  is  estimated  to  account  for  any  residual  contributions  from  the  sky  and  sea 


surface,  a  spectrally  constant  value  is  removed  from  the  calculated  Rr,(A)  in  order  to  obtain  an 

average  of  zero  for  the  spectral  range  of  810-840  nm,  where  contributions  from  water  arc  considered 
null  [11]. 


In  this  study  we  compare  HICO  data  atmospherically  corrected  using  the  standard  NIR  and  C&S 
methods  for  a  scene  over  Key  Largo,  Florida  taken  on  November  13,  2009.  Furthermore,  we  also 
introduce  a  cloud  shadow  detection  approach  called  Cloud  Shadow  Algorithm  (CSA)  and  present  some 
preliminary  results  using  HICO  data. 

THEORETICAL  BACKGROUND  AND  DEVELOPMENT  OF  THE  CLOUD  SHADOW 
ALGORITHM 


Identification  of  cloud  shadows  over  water  still  remains  a  challenge  from  space  borne  visible  sensors. 

It  is  very  difficult  to  distinguish  the  water  bodies  from  the  shadow  areas  if  it  is  based  on  spectral 
reflectance  shape  and  amplitude  information  [12].  However,  accurate  identification  of  shadows  is  very 
important,  because  optical  properties  retrieved  from  these  pixels  will  be  in  error.  Additionally,  they 
can  be  used  with  their  cloud  pair  and  adjacent  sunny  region  to  remove  the  atmospheric  interference, 
which  still  remains  a  challenge  particularly  over  turbid  coastal  waters. 

Assume  a  small,  compact,  thick  cloud  over  water  removes  direct  solar  photons  and  shadows  a  region. 
The  water-leaving  radiance  from  the  shadowed  region,  LwsJk,(A)  that  reaches  the  sensor  results  from 

only  skylight  photons  since  direct  photons  arc  removed  by  the  cloud.  An  adjacent  patch  of  water  from 
a  sunny  region  has  identical  inherent  optical  properties  to  those  of  the  shadow  region.  Refer  water- 
leaving  radiance  from  the  neighboring  sunny  region  as  Lwsnv  (A) ,  which  results  from  illumination  of 

both  direct  solar  and  skylight  photons. 
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In  addition  to  the  water-leaving  radiance,  radiance  recorded  at  the  sensor  also  includes  path  radiance 
due  to  molecular  (or  Rayleigh)  scattering  and  particulate  (or  aerosol)  scattering  from  the  field  of  view 
of  the  sensor.  The  path  radiance  can  be  due  to  only  Rayleigh  scattering,  only  aerosol  scattering,  or 
some  combination  of  both.  These  three  types  of  path  radianec  arc  denoted  by  Lr ,  La  and  Lra 
respectively. 

The  total  radiance  measured  at  the  sensor’s  altitude  from  the  sunny  area  can  be  expressed  as 

Lt^(A)  =  W)+LM)  +  LM)+‘(W»«yW  (1) 

where  t(A)  represents  the  diffuse  transmittance  of  the  atmosphere  for  the  water-leaving  radianec. 

The  total  radiance  measured  at  the  sensor’s  altitude  over  the  shadowed  region  can  be  expressed 
similarly,  but  some  differences  in  the  path  radiance  and  diffuse  transmittance  can  be  expected.  The 
path  radiance  from  the  shadow  region  should  be  lower  since  part  of  the  viewing  path  to  the  shadowed 
region  is  also  shadowed,  so  it  must  produce  less  path  radianee  depending  on  how  much  of  the 
atmosphere  is  shadowed  [5].  While  the  apparent  path  transmittance  of  the  water-leaving  radiance  from 
the  shadowed  region  maybe  slightly  higher  sinee  the  adjaeent  areas  of  the  scene  are  generally  brighter 
and  so  the  apparent  transmittance  of  the  viewing  path  to  the  shadow  will  be  enhanced  by  photons 
reflected  from  the  bright  portion  of  the  image  and  scattered  into  the  field  of  view  of  the  sensor  [5]. 

So  the  total  radianee  measured  over  the  shadowed  region  can  be  expressed  as 

LtsJw(A)  =  Lr(A)-Mr(A)+LM)~  ALJA)  +  LJA)-AI.JA)  +  (t(A)  +  At(A))Lws<yH.(A)  (2) 

The  A  term  represents  the  perturbations  due  to  the  differences  in  scene  illumination  from  the  sunny 
pixels. 

The  water-leaving  radiance  can  be  expressed  as  two  parts:  one  part  caused  by  the  backscattcring  of  the 
diffuse  skylight  and  the  other  part  by  baekscattering  of  the  direet  solar  beam.  For  the  sunny  and 
shadow  region,  it  ean  be  expressed  as 

LW,m(A)  =  Lw%(A)  +  Lw%(A)  and  LwsJh(A)  =  Lw%.(A) respectively 
Beeause  Lw^.(A)  -  0 

Where  Lwfn'v(A)  and  Lwfn[(A)  represents  water-leaving  radiance  caused  by  diffuse  skylight  and  direct 

solar  beam  in  the  sunny  region  respectively,  while  Lwfj*,(A)  and  Lwf^.(A)  represents  water-leaving 
radiance  eaused  by  diffuse  skylight  and  direct  solar  beam  in  the  shadow  region  respectively. 

The  diffuse  irradiancc  incident  on  the  shadow  and  close  by  sunny  areas  arc  unequal  because  scattering 
from  eloud  may  increase  the  diffuse  irradianee  incident  at  the  neighboring  sunny  region  [5].  So, 
according  to  Reinersman  et  al.,  1998  Lwf^(A)  ean  be  expressed  asLw^(A)  =  Lvv^  (i)  +  ALw^XA) . 
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Based  on  the  above  hypothesis,  it  can  be  expected  that  the  water-leaving  radiance  from  the  shadow 
region  ( Lwsdw(A) )  reaching  the  satellite  sensor  is  lower  than  the  water-leaving  radiance  from  the 

neighboring  sunny  region  ( Lwsm  (A) ).  But,  we  are  assuming  that  the  optieal  properties  in  the  two 

regions  arc  the  same  (beeause  they  are  adjacent).  Also  the  total  path  radianee  from  the  shadow  region 
is  slightly  lower  since  part  of  the  atmosphere  is  also  shadowed  which  must  produce  less  path  radianee 
depending  on  how  mueh  of  the  atmosphere  is  shadowed.  As  a  result  the  total  radianee  measured  over 
the  shadowed  region  is  lower  than  the  neighboring  sunny  region.  Even  though  these  differences  are 
small,  we  find  that  integrating  the  blue-green  region  of  the  spectrum  amplifies  these  small  differences 
and  allows  separation  of  the  two  regions.  However,  integration  alone  is  not  adequate  to  separate  them 
using  a  threshold.  To  achieve  separation,  we  normalize  the  integrated  value  (IV)  of  the  pixel  under 
question  (needs  to  be  classified  either  as  a  shadowed  or  sunny  pixel),  by  the  mean  of  the  IV  values 
within  an  Adaptive  Sliding  Box  (ASB)  centered  on  this  pixel. 


We  define  our  cloud  shadow  detection  approach  based  on  the  water  and  atmospheric  eharaeteristies  of 
shadow  and  neighboring  sunny  region.  For  eonvenienee,  we  call  this  the  Cloud  Shadow  Algorithm 
(CSA): 

Green 

IV  =  |  Lt(A)dA  (3) 

Blue 


CSA  = 


i±M 

mean(IV(Q)) 


(4) 


Where  ^  (Q)  represents  the  IV  value  at  the  pixel  which  need  to  be  classified  either  as  a  shadow  or 
sunny  pixel.  The  ASB  should  be  selected  centered  on  this  pixel.  The  ",ea"CI  (□)) represents  the  mean 
of  IV  values  within  the  selected  ASB  of  this  pixel.  This  proeess  should  be  repeated  for  all  pixels  except 
for  the  edge  pixels.  The  edge  pixels  are  ignored  for  now  since  an  ASB  cannot  be  selected  centered  on 
these  pixels.  For  this  study  we  selected  a  constant  32x32  pixel  ASB.  Note  that  before  applying  CSA, 
land  and  clouds  should  be  masked  otherwise  spurious  results  can  be  expected. 


Our  preliminary  study  on  16  selected  HICO  images  shows  that  CSA  <  0.96  seem  to  separate  the 
shadowed  pixels  reasonably  well.  This  is  beeause  the  ASB  for  any  particular  pixel  have  only  sunny 
and/or  shadow  pixels  (everything  else  should  be  removed)  and  the  water  is  homogeneous  within  the 
ASB.  So,  for  a  shadow  pixel  the  CSA  will  shrink  since  the  IV  value  (numerator  of  eq.  4)  will  be 
smaller  than  the  mean  of  the  ASB  (denominator  of  eq.  4)  which  has  both  shadow  and  sunny  pixels. 
While  for  a  sunny  pixel  the  CSA  will  be  around  one  if  ASB  has  only  sunny  pixel  and  greater  than  one 
if  ASB  has  both  sunny  and  shadow  pixels.  So,  the  proposed  threshold  ean  separate  them  easily. 
However,  if  the  ASB  contains  only  shadow  pixels,  this  will  create  problems.  So,  the  ASB  need  to  be 
selected  carefully  so  that  it  is  slightly  larger  than  the  shadow  size,  which  ean  be  approximated  using 
cloud  size  information  that  is  relatively  easy  to  determine.  Also  if  the  water  is  non-homogeneous 
within  the  ASB,  spurious  results  ean  be  expeeted.  Thus,  CSA  should  be  appropriate  for  homogeneous 
water  bodies  sueh  as  open  oeean.  However,  an  observer  ean  use  the  IV  values  (eq.  3)  to  visually 
identify  the  elouds  and  shadows  over  non-homogeneous  waters. 


4 


RESULTS  AND  DISCUSSIONS 


The  CSA  shadow  detection  approach  with  the  proposed  threshold  has  been  tested  on  16  HICO  images 
and  the  results  were  compared  visually  with  the  true  color  images.  Our  preliminary  result  shows  that 
CSA  in  general  detects  cloud  shadows  reasonably  well  over  homogeneous  water  bodies.  Figure  1  is  an 
example  of  shadow  detection  over  Virgin  Island  collected  on  December  20,  2009.  Since  most  of  our 
tested  images  have  small  puffy  cumulus  clouds,  we  used  a  constant  32><32  ASB  box  to  determine  CSA 
values.  However,  to  detect  all  size  of  shadows  the  ASB  should  be  selected  carefully  so  that  it  doesn’t 
only  contain  shadow  pixels. 


Figure  1.  HICO  Image  acquired  over  Virgin  Island  on  December  20,  2009.  Left:  full  scene  true 
color  image ;  centre:  zoomed  view  of  true  color  image;  right:  zoomed  view  of  CSA  image. 


Figure  2  shows  RrfA.)  from  the  coastal  waters  of  Key  Largo,  Florida  collected  on  November  13,  2009. 
Solid  lines  arc  Rrs{2.)  calculated  using  the  C&S  atmospheric  correction  while  the  dashed  lines  with 
squares  arc^?rj(T)  calculated  using  standard  NIR  atmospheric  correction  at  HICO  MODIS-likc 

channels.  These  spectra  arc  averaged  over  2><2  pixels.  The  spectra  with  the  same  color  (solid  and 
dashed)  in  the  right  panel  of  Fig.  2  arc  taken  from  the  same  location,  which  is  indicated  in  the  left 
panel  of  Fig.  2  with  the  same  colored  squares.  In  general,  both  atmospheric  corrections  seem  to  agree 
in  these  coastal  waters.  However,  MODIS-likc  spectra  seem  to  have  some  problem  at  the  412nm 
channel  where  significantly  higher  values  arc  observed.  We  arc  still  investigating  this  issue.  On  the 
other  hand,  the  C&S  spectra  seem  reasonable,  and  typical  of  coastal  areas.  Unfortunately,  no  in-situ 
data  is  available  to  validate  the  results. 
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Wavelength  (nm) 


Figure  2.  Left:  H/CO  true  color  image  (November  13,  2009)  over  Florida,  Key  Largo.  Right: 
Remote-sensing  reflectance  spectra  from  the  pixels  indicated  in  the  left  scene.  Solid  lines  are  Rn  (A) 

corrected  using  C&S  method  and  dashed  lines  with  squares  are  Rrs(A)  corrected  using  standard 

NIR  method  at  HICO  MODIS  like  channels.  Solid  and  dashed  spectrums  with  same  color  represent 
same  location  which  is  indicated  in  left  scene  with  same  color  square  box  and  they  are  averaged 

over  2*2  pixels. 


CONCLUSION 

Our  preliminary  results  on  HICO  data  show  that  the  CSA  cloud  shadow  detection  approach  seems  to 
work  reasonably  well  over  Open  Ocean.  However,  further  studies  are  required  to  fully  automate  the 
approach,  in  particular  how  to  select  the  ASB  for  any  particular  pixel  and  how  to  account  for  edge 
pixels  (which  are  currently  being  ignored). 

The  Cloud  and  Shadow  atmospheric  correction  yields  reasonable  reflectance  values.  However, 
additional  work  is  required  to  validate  the  results  using  in  situ  data.  The  NIR  atmospheric  correction 
applied  to  the  multispcctral  (convolved)  HICO  bands  yields  reasonable  results  over  coastal  areas. 
Issues  with  the  412nm  channel  arc  under  investigation.  In  addition,  we  arc  developing  a  hypcrspcctral 
NIR  approach  that  is  under  evaluation. 
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